DOCUMENT RESUME 



ED 469 747 



TM 034 538 



AUTHOR 

TITLE 

INSTITUTION 

PUB DATE 
NOTE 

AVAILABLE FROM 



PUB TYPE 
JOURNAL CIT 
EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Barton, Paul 

A Deeper Look at NAEP Science Results. 

Educational Testing Service, Princeton, NJ. Policy 
Information Center. 

2002 - 00-00 
1 Op . ; Theme • issue . 

ETS Policy Information Center, Educational Testing Center, 
Rosedale Road, 04-R, Princeton, NJ 08541-0001. Tel: 609-734- 
5694; e-mail: pic@ets.org; Web site: 
http : //www. ets . org/research/ pic . 

Collected Works - Serial s (022) 

ETS Policy Notes; 11 nl Fall 2002 
EDRS Price MF01/PC01 Plus Postage. 

^Educational Trends; Elementary Education; Grade 4; Grade 8; 
Longitudinal Studies; *Low Achievement; National Surveys; 
^Science Achievement; Science Tests; Standards; Trend 
Analysis 

^National Assessment of Educational Progress 



ABSTRACT 

This issue presents the results of a special analysis of NAEP 
state-by-state science data from 1996 to 2000 carried out by the Educational 
Testing Service under contract with the National Center for Education 
Statistics. The focus is on changes in the gap in scores between different 
groups of students. There were a few bright spots, but overall the results 
over this 4-year period of national concentration on standards-based reform 
were disappointing. There were no improvements on three indicators: the gap 
between the top and bottom quartile, the gap between white and minority 
students, and the gap between poor and nonpoor students. The gap actually 
grew in 11 states between the top and bottom quartiles and in 7 states 
between poor and nonpoor students. Only one state showed an improvement for 
the bottom quartile of students, but 17 states registered an improvement for 
the top quartile of the student population, and 7 states increased the 
percentage of students reaching the "proficient" level. Only three states, 
however, raised the statewide average scores. One state improved on four of 
seven indicators, and just two states improved on three indicators. Results 
underscore ‘the importance of examining multiple indicators of state 
performance when analyzing NAEP data. (SLD) 




Reproductions supplied by EDRS are the best that can be made 
from the original document. . 



TM034538 





POLICY NOTI 

News from the ETS Policy Information Center 



VOLUME 11, Number 1 



Fall 2002 



A Deeper Look at NAEP 
Science Results 



nff U S f ^ PAR ™ ENT 0F EDUCATION 
Office of Educational Research and Improvement 

EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 

O^Th is document has been reproduced as 
received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 



PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL HAS 
BEEN GRANTED BY 

R. J. Colev 



Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 




Policy Information Center 
Educational Testing Service (ETS) 

BIST COPY AVAILABLE 

2 



(Eh) POLICY NOTES 



News from the ETS Policy Information Center 




Volume 1 1, Number 1 



Educational Testing Service 



Fall 2002 



A Deeper Look at NAEP Science 
Results 

Introduction 

Persistent and disturbing differences in academic 
achievement among U.S. students, usually apparent 
when students are grouped by race/ethnicity and/or 
some measure of socioeconomic status, have received 
renewed attention from education policymakers. This 
focus on the achievement gap in the U.S. education 
system carries forward Goal 3 of the national education 
goals that students should demonstrate knowledge in 
“challenging subject matter,” with the objective that 
“the academic performance of all students... will 
increase significantly in every quartile, and the distri- 
bution of minority students in every quartile will more 
closely reflect the student population as a whole.” This 
goal is renewed in the No Child Left Behind Act of 
2001, which focuses on raising the academic achieve- 
ment of all students, setting a minimum threshold of 
performance toward which the lowest achieving sub- 
groups of students must show progress on assessments 
in use in each state. 

The major tool available to measure the overall 
achievement of U.S. students is the National Assess- 
ment of Educational Progress (NAEP), which regularly 
reports average scale scores and the percentage of stu- 
dents reaching specific “achievement levels” set by 
the National Assessment Governing Board. 1 National 



This issue — A Deeper Look 
at NAEP Science Results 

This issue of ETS Policy Notes 
presents the results of a special 
analysis of NAEP state-by-state 
science data from 1996 and 2000 
carried out by ETS under con- 
tract with the National Center 
for Education Statistics. The 
focus is on changes in the gap 
in scores between different 
groups of students. 

Readers interested in more gen- 
eral results from the 2000 NAEP 
science assessment should see 
Science Highlights 2000, available 
from the National Center for 
Education Statistics (http:// 
nces.ed.gov/nationsreportcard/ 
science/results/index.asp) . 

Editor’s note: This issue of ETS 
Policy Notes was written by Paul 
Barton, with data analysis pro- 
vided by David Freund and 
Mei-jung Lin. 



1 For more information on NAEP, go to http://nces.ed.gov/nationsreponcard. 
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